mm duq 

HUMAN NEUROSCIENCE 



METHODS ARTICLE 

published: 05 March 2014 
doi: 10. 3389/fnhum. 2014.00121 




MoBILAB: an open source toolbox for analysis and 
visualization of mobile brain/body imaging data 

Alejandro Ojeda * Nima Bigdely-Shamlo and Scott Makeig 

Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA, USA 



Edited by: 

Klaus Gramann, Berlin Institute of 
Technology, Germany 

Reviewed by: 

Robert Oostenveld, Cognition and 
Behaviour Centre for Cognitive 
Neuroimaging, Netherlands 
Alexandre Gramfort, Telecom 
ParisTech CNRS, France 

'Correspondence: 

Alejandro Ojeda, Swartz Center for 
Computational Neuroscience, 
Institute for Neural Computation, 
University of California San Diego, 
9500 Gilman Drive #0559, La Jolla, 
CA 92093-0559, USA 
e-mail: alejandro&sccn. ucsd. edu 



A new paradigm for human brain imaging, mobile brain/body imaging (MoBI), involves 
synchronous collection of human brain activity (via electroencephalography, EEG) and 
behavior (via body motion capture, eye tracking, etc.), plus environmental events (scene 
and event recording) to study joint brain/body dynamics supporting natural human 
cognition supporting performance of naturally motivated human actions and interactions 
in 3-D environments (Makeig et al., 2009). Processing complex, concurrent, multi-modal, 
multi-rate data streams requires a signal-processing environment quite different from one 
designed to process single-modality time series data. Here we describe MoBILAB (more 
details available at sccn.ucsd.edu/wiki/MoBILAB), an open source, cross platform toolbox 
running on MATLAB (The Mathworks, Inc.) that supports analysis and visualization of any 
mixture of synchronously recorded brain, behavioral, and environmental time series plus 
time-marked event stream data. MoBILAB can serve as a pre-processing environment for 
adding behavioral and other event markers to EEG data for further processing, and/or as a 
development platform for expanded analysis of simultaneously recorded data streams. 

Keywords: EEG, motion capture, mobile brain/body imaging, MoBI, EEGLAB, multimodal neuroimaging 



INTRODUCTION 

For nearly 50 years the dominant approach to cognitive EEG 
experiment protocols and subsequent data analyses has been the 
Event Related Potential (ERP) paradigm in which EEG epochs 
are extracted from the continuous EEG data time-locked to one 
or more classes of experimental events (typically, stimulus onsets 
or finger button presses). Event-locked averages of these epochs 
(ERPs) extract the relatively small portion of the EEG that is both 
time-locked and phase-locked to the events of interest (Makeig 
et al., 2004). The same paradigm can be extended to linear 
transforms of the channel data including its maximally indepen- 
dent component processes (Makeig et al., 1996, 2002), and/or 
to time/frequency transforms of these EEG time series (Makeig, 
1993; Tallon-Baudry et al, 1996; Delorme and Makeig, 2004). 

The ERP paradigm assumes that differences in EEG dynam- 
ics across event-related trials unrelated to the experimental events 
of interest can be eliminated through random phase cancellation 
by averaging a sufficient number of event time-locked epochs. 
To maximize the effectiveness of this assumption, participants 
in ERP experiments are typically instructed to sit still and to 
minimize blinks and other muscle activities while performing 
some task involving evaluation of presented stimuli, the partic- 
ipant indicating his or her stimulus decisions by pressing a finger 
button (or "micro switch"). During data analysis these button 
press responses are considered to be in effect (point) processes 
without spatial or temporal extent. However, the instruction to 
refrain from blinking and making any other extraneous move- 
ment is in effect a dual-task that forces the brain to operate 
under unnatural and somewhat stressful circumstances (Verleger, 
1991). It also severely restricts the range of task paradigms 
and behaviors that can be employed to observe and understand 



how human brain dynamics support our natural behavior and 
experience. 

A new direction in experimental paradigm design was pro- 
posed by Makeig et al. (2009) to enable, for the first time, 
measurement and analysis of human brain dynamics under nat- 
uralistic conditions including subject eye and motor behavior in 
3-D environments. Compared to previous modes of functional 
brain imaging, the new concept in effect proposed a new brain 
imaging modality that Makeig et al. termed mobile brain/body 
imaging (MoBI). In this paradigm, synchronized streams of 
behavioral and environmental time series data are measured 
along with subject EEG and/or other brain and physiological sig- 
nals. In many practical circumstances, data collection rates may 
differ and some information streams may be sampled irregu- 
larly. Combining data modalities as different as motion capture, 
eye tracking, sound and video recordings, etc., with high-density 
EEG data allows study of brain dynamics under conditions much 
closer to everyday life. To date the MoBI paradigm has been 
applied in studies of brain dynamics supporting gait, balance, 
and cognition during walking (reviewed in Gramann et al., 201 1; 
Sipp et al., 2013) and to study expressive gesturing (Leslie et al., 
in press). 

Traditional scalp-channel ERP analysis can be carried out in 
almost all available EEG toolboxes including EEGLAB (Delorme 
and Makeig, 2004), Brainstorm (Tadel et al., 2011), FieldTrip 
(Oostenveld et al., 2011), BrainVision Analyzer, and SPM (Friston 
et al., 1994). However, since EEG software has most often been 
designed to handle unimodal EEG data (plus one or more event- 
marker channels), a new tool set is needed to deal with the 
complex analysis problems involved in efficient analysis of multi- 
modal MoBI data. 
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A related experimental EEG paradigm of increasing research 
interest is the development of brain-computer interface (BCI) 
models and applications (Makeig et al., 2012). In this paradigm, 
brain activity associated with a cognitive state or task is used to 
estimate a model of a subject's cognitive brain state, response, 
or intent with a goal of classifying or estimated current or 
future responses so as to control external interfaces (Schneider 
and Wolpaw, 2012). When the subject (or an external inter- 
face) requires a timely interpretation of current brain/behavior 
state or intent, a near real-time pipeline is needed to process the 
data and estimate and/or update the model continuously. Near 
real-time signal processing may impose serious computational 
constraints on the signal processing methods that can be used, 
limiting the type and range of states estimated and the number 
of data streams processed (Wang and Jung, 2013). Basic studies 
of brain dynamics, on the other hand, may use latent variables 
in complex BCI models trained off-line to model brain state 
or dynamics associated with subject brain states, responses, or 
intent during an EEG or MoBI experiment. Typically, dynamic 
features used in such models are optimally selected in some fash- 
ion from a large repertoire of possible features. Examination of 
the model features so selected may be termed informative fea- 
ture analysis. Current leading edge BCI toolkits include BCILAB 
(Kothe and Makeig, 2013) and BCI2000 (Schalk et al, 2004). 
Other EEG toolboxes such as MNE (Gramfort et al, 2014) and 
FieldTrip provide basic support for real-time signal processing 
as well. BCILAB, in particular, provides a strong basis for infor- 
mative feature analysis of recorded EEG and/or multi-modal 
data. 

The MoBILAB toolbox introduced here is designed to sup- 
port analysis and visualization of any number of concurrently 
recorded multimodal data streams during off-line analysis. To 
extend human EEG analysis tools to encompass new modes of 
analysis of multiple physiological and behavioral data modali- 
ties while making the basic software functions easy to use and 
build upon, MoBILAB exploits the most recent advances in 
object-oriented programming supported by MATLAB Versions 
7.5 and above. To learn more about MATLAB object ori- 
ented programming, see MathWorks on-line documentation 
under mathworks.com/help/matlab at matlab_oop/classes-in- 
the-matlab-language.html. 

SOFTWARE ARCHITECTURE 

MoBILAB is composed of three independent functional mod- 
ules: (1) the Graphic User Interface (GUI), (2) a data objects 
container, and (3) any number of modality-specific data stream 
objects (or stream objects). These three modules decouple GUI, 
file I/O, and data processing, thus allowing extensions and/or re- 
implementation of parts of the toolbox without making dramatic 
changes to the whole system, e.g., preserving large, still-stable 
parts of the code. Figure 1 below shows a schematic of the 
MoBILAB architecture. 

The MoBILAB GUI is controlled by a "mobilab Application" 
object called "mobilab" this object creates the interactive tree in 
which the raw data stream objects and its descendants are rep- 
resented; it also assigns a modality-specific menu item to each 
object. 



The data object container is implemented in the class "data- 
Source"; this object imports a multimodal data file and collects 
modality-specific data stream objects in a cell array that is stored 
in the object property item. As a container, the dataSource object 
defines easily applied methods for deleting and inserting stream 
objects that take care of updating the logical pointers encoding 
parent-child relationships among the elements of the tree. To read 
a new file format, for example, a new class can be derived inherit- 
ing from dataSource its basic functionalities while implementing 
only the format-specific data reading method. 

Natively, MoBILAB reads multimodal data files in 
the extensible data format (XDF) (freely available at 
code.google.com/p/XDF) designed to work both with MoBILAB 
and with the Lab Streaming Layer (LSL) data acquisition and 
control framework of Christian Kothe (Delorme et al., 2011), 
software freely available at code.google.com/p/labstreaminglayer. 
To import.xd/ files produced by LSL during MoBI experiments, 
MoBILAB defines the child class "dataSourceXDF" When an.xdf 
file is imported by dataSourceXDF, a set of header and binary 
files are created for each data stream read from the source.xdf 
file. Data stream objects are then constructed that map the 
metadata and data samples contained in the header and binary 
data files, respectively, onto object properties. Data sample 
mapping uses memory-mapping (detailed below). This mapping 
between object properties and files allows automatic file updating 
by modifying stream object properties. The dataSource object 
is stored in mobilab property allStreams and can therefore be 
accessed from the MATLAB workspace as mobilab.allStreams. 

Data stream objects are organized in a hierarchy with base 
class dataStream; this class defines some methods that operate 
on generic time series data, including resample, filter, and plot. 
Deriving from the dataStream base object allows straightfor- 
ward definition of modality-specific data stream objects includ- 
ing objects that handle EEG, motion capture, or eye track- 
ing data, among others. In the specific case of EEG data, 
the class eeg is defined to also derive from the class head- 
Model, allowing integration of spatial anatomical information 
with functional information contained in the EEG time series 
(see Figure 2). 

COLLECTION AND SYNCHRONIZATION OF MULTIPLE DATA 
STREAMS BY LSL 

MoBILAB itself is not meant for use during data collection, but 
for off-line data exploration. When reading multi-stream data 
irom.xdf files, MoBILAB makes use of the time synchronization 
provided by the LSL (Lab Streaming Layer, referenced above) 
acquisition system. LSL implements time synchronization of con- 
currently recorded data streams by associating every collected 
sample with a timestamp provided by the high-resolution clock 
of the local computer on which the LSL data recorder applica- 
tion is running. When multiple data streams are recorded, LSL 
also estimates and stores the relative clock offsets among them. 
In general, multiple data streams may be collected concurrently 
via different computers located on a local area network, any one 
(or more) of which may serve to save the synchronized data to 
disk as an.xdf file that can then be imported into MoBILAB for 
review and processing. As it reads the file (using LSL function 
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FIGURE 1 I The MoBILAB toolbox architecture. From left to right: through 
the MoBILAB GUI (upper left), the user can read new or previously processed 
data sets (right) in one of several formats [currently Lab Streaming Layer 
(.xdf), EEGLAB (.set), or MoBILAB (.hdr,. bin)] and instantiates a corresponding 
dataSource object that identifies the constituent data streams and creates 
stream-specific objects to handle them. Each data stream object defines 



methods for processing and visualization of the type of data it contains. The 
connecting arrows indicate that each MoBILAB module can communicate 
bi-directionally with any other object it interfaces. Each data stream object 
handles two files, a header that provides metadata about its properties, and a 
binary data file that is memory mapped to disk, allowing its data (no matter 
how large) to be accessed through its data field. 



load_xdf.m), MoBILAB corrects the data stream timestamps by, 
first, estimating an (assumed) linear fit through the (possibly 
noisy) clock offsets and then correcting the time stamps for 
implied bias and drifts. 

In practice, LSL can achieve millisecond precision or better 
synchronization, though only when the (non-zero) delay within 
each data acquisition device, from data sample capture to net- 
work sample transmission, is measured and made available to 
LSL in a device delay information file. Device delay informa- 
tion is most often best learned by direct measurement of each 
device. For example, the sample delay we have measured within 
our laboratory Biosemi Active 2 EEG system is 8 ms. When device 
delay information is available, LSL also corrects the.xdf file data 
stream timestamps for the measured delays, thereby achieving 



maximum stream synchronization accuracy while relieving.xd/ 
data read functions of the need to locate and make use of this 
information. 

MEMORY MANAGEMENT 

In contrast to the common practice of representing data streams 
as matrix variables in the MATLAB workspace with computer 
random access memory (RAM), MoBILAB stores its working 
data in MATLAB memory-mapped data objects. Such memory- 
mapped objects are used, for example, by SPM (Friston et al., 
1994) to represent MRI data. These objects organize the data in 
disk files optimized for fast random access, making it possible 
for MoBILAB to process data streams of virtually any size with- 
out requiring the host computer to have an unlimited amount 
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FIGURE 2 | The dataStream class hierarchy. From left to right: the base class 
coreStreamObject. This is the common ancestor of all data stream objects, it 
defines the underlying machinery for storing data in a memory-mapped source 
file and accessing it as a matrix though its data property. Next (right) in the 
hierarchy is the dataStream class that defines methods for processing generic 



time series data including data resampling, digital filtering, independent 
component analysis, etc.. From this are derived specific data stream classes 
including eeg for EEG data, mocap for motion capture data, gazeStream for 
data eye gaze data, etc. The hierarchy can be extended to support new data 
modalities by defining new classes that descend from any existing class. 



of RAM, with relatively little compromise of compute perfor- 
mance (particularly as solid state and other disk access latencies 
continue to decrease). Each stream object is created from two 
files: (1) a.hdr header file that contains stream object metadata in 
MATLAB format, and (2) a.bin binary file that contains the data 
stream samples. Based on information in the header file, portions 
of the binary file are mapped into main memory only as and when 
needed. These operations are transparent to both MATLAB users 
and programmers. Data samples can be accessed using standard 
MATLAB and EEGLAB data matrix syntax through the dataS- 
tream object property data. Thus, MATLAB syntax for accessing 
data in EEGLAB and MoBILAB datasets appears similar: 

>>this_data = EEG. data; % copy EEGLAB "EEG" structure 
% data into a MATLAB matrix 

>>this_data = eegObj.data; % copy MoBLLAB "eegObj" object 
% data into a MATLAB matrix 
In the example above note that — contrary to the EEGLAB 
convention — MoBILAB represents data using samples as the 
first dimension and channels as the second (the transpose of 
EEG. data). The reason for this design choice is that MATLAB 
represents matrices internally as column-wise vectorized arrays. 
This is because operations performed channel-by-channel (for 
example, spectral filtering, correlations, etc.), run faster if chan- 
nel samples are next to each other in RAM or on disk, as modern 
systems cache values before processing them. 

Currently MoBILAB includes object classes to read/write, ana- 
lyze, and visualize EEG, motion capture, eye tracking, and force 



plate data as well as recorded audio and/or video scene data. 
These classes include methods to apply spectral filters, com- 
pute temporal derivatives, and perform wavelet time-frequency 
decomposition, independent component analysis (ICA), or prin- 
cipal component analysis (PCA), plus some methods for electrical 
forward head modeling and inverse EEG source modeling not 
discussed here. 

THE MoBILAB MULTI-STREAM BROWSER 

In MoBI experiments, the ability to review, interactively, the EEG 
data together with any other synchronously acquired data streams 
is critical for selecting, performing, and evaluating data measured 
during a MoBI experiment and for determining an appropriate 
data analysis path. The MoBILAB Multi-Stream Browser allows 
visual inspection, annotation, and sanity checking of recorded 
multistream data, and can also provide useful insights about sus- 
pected or previously unknown relationships between behavioral, 
environmental, and EEG data features. Each dataStream object 
has a built-in plotting function (a plot method) that displays the 
data stream in a natural manner. For some streams, more than 
one plotting method is supported to provide the benefits of dif- 
ferent types of visualization. For instance, EEG may be displayed 
as a scrolling multi-channel time series or as an animated topo- 
graphic scalp map, body motion capture data as movements of 
one or more 3-D stick figures, fixations in eye tracking data as 
time series or 2-D heat maps, etc. Extending MoBILAB plotting 
capabilities to a new type of dataStream is simple because core 
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functions including data scrolling, interactive cursor actions, and 
other controls have been implemented in the base class browser- 
Handle from which a programmer user can easily derive a new 
browser class by replacing and/or adding new elements that best 
suit the new data type. 
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FIGURE 3 | A MoBILAB Multi-Stream Browser session comprising five 
(top) MATLAB figure windows that give user-selected, temporally 
coordinated views of raw and/or derived data streams within a 
multi-stream MoBI dataset, plus (bottom) a browser control window. 

(A) Full body motion capture of participant's rhythmic hand and arm 
movements, animated on a 3-D human stick figure whose body position 
depicts subject position at the current moment (CM) in the data, marked in 
the scrolling time series data windows by CM indicators (vertical red lines). 
(B,C) Derived (x, y, z) velocity and acceleration time series for the (red) left 



Though each dataStream object can be visualized separately, 
either from the MoBILAB GUI or from the command line, when 
plotted through the Multi-Stream Browser multiple browser win- 
dows can be controlled from a single GUI (Figure 3). This control 
window performs user-directed scrolling through multimodal 
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hand marker in (A), shown in a 10-s window containing the CM. (D) EEG time 
series for a 32-channel EEG channel subset, shown in a 5-s window 
containing the CM. (E) The EEG scalp topography at the CM, visualized by 
interpolating the channel EEG data on a template head model. (F) The 
Multi-Stream Browser control window. Movement of the CM in all browser 
windows at once can be controlled either by manipulating the play buttons or 
scroll bar in this window or by moving the red vertical CM indicator in any 
scrolling data window. Pressing play will animate the stick figure and scalp 
map displays to match the advancing CM. Data from (Leslie et al., in press). 
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data (and/or through data streams derived from such data) either 
for multimodal data review and/or to mark experimental events 
of interest for further analysis. 

Although when the Multi-Stream Browser is not meant for 
on-line data viewing, it is similar in spirit to Video-EEG moni- 
toring systems used in epilepsy or sleep studies. However, unlike 
the MoBI data, in these systems the data are mostly recorded 
for clinical purposes and not always analyzed in great detail. As 
a complement, MoBILAB could be used in those cases where a 
more sophisticated analysis is required, as it provides the tools 
needed for multimodal data processing and exploration. 

DATA PROVENANCE 

Figure 4 shows two sample MoBILAB GUI pipelines: (1) to 
process EEG data: raw data =>• re-referencing =>■ high-pass fil- 
tering =>• artifact rejection =>• ICA decomposition; (2) to process 
motion capture data: raw data =>■ occlusion artifact cleaning =>• 
low pass filtering =>• computation of time derivatives. Central to 
MoBILAB's design is its built-in data provenance, that gives users 
the ability to track and recall all the transformations applied to 
the data in a processing pipeline. Every stream object has a history 
property that is initialized at the moment of its creation with the 
command and the parameters that were used to generate it. This 
mechanism allows representing pipelines in which child datasets 
are processed versions of a parent set. Graphically, parent-child 



links can be visualized as a tree. To make this tree as functional 
and interactively accessible as possible, MoBILAB embeds the Java 
component /Tree in the main MoBILAB GUI. This /Tree compo- 
nent allows the creation of contextual menus for each data object 
in the tree. By climbing back up any branch of the tree (using 
menu item "Generate batch script"), the user can generate scripts 
that ease the task of running the same sequence of operations on 
other datasets. 

Other toolboxes including Brainstorm (Tadel et al., 2011) have 
successfully exploited this approach, making the user's interaction 
with the application simpler and more natural feeling. In multi- 
modal data analysis, each data stream may have a different set of 
processing or pre-processing methods. For ease of use, therefore, 
MoBILAB provides a flexible menu interface that offers (only) 
selections relevant to each type of data stream present in the data. 

The MoBILAB tree is meant to ease the analysis and explo- 
ration of different data types by exposing modality-specific stan- 
dard options for visualization and analysis. Joint analysis of 
multi-rate MoBI data is still in an early stage, however. Though 
it is not yet possible to create converging multi-stream data 
processing pipelines from the GUI, it is possible for example 
to compute desired measures for more than one data stream 
and to then estimate their joint subject-level statistics through 
custom MoBILAB scripts, as demonstrated in (Leslie et al., 
in press). 
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FIGURE 4 | The MoBILAB GUI and processing pipelines. The left panel 
shows the tree of parent-children relationships among data objects in a 
loaded multi-stream MoBI dataset. The integers enclosed in parentheses to 
the left of each object name give the index in the cell array 
mobilab.allStream.item. The two branches shown unfolded (by clicking on the 
data object names, here biosemi and phasespace) represent two already 
selected data processing pipelines (cf. Text Boxes 1, 2): (1) for Biosemi 
(Amsterdam) system EEG data: raw data => re-referencing high-pass 
filtering artifact rejection => ICA decomposition; (2) for PhaseSpace (Inc.) 
system motion capture data: raw data correction of occlusion 



artifacts => low-pass filtering computation of time derivatives. By following 
any branch backwards (upwards), the user can generate MATLAB scripts that 
make it easy to run the same series of operations on other Biosemi and 
PhaseSpace datasets. The center panel shows the contextually defined 
menu for the EEG dataStream object. The menu item shaded in blue 
backtracks the history of every object in the selected branch, creating a script 
ready to run (see Text Box 1). The right panel shows the contextually defined 
menu for the motion capture data object (see Text Box 2). Note that the two 
stream objects (EEG and motion capture) have different processing menus 
that present their individually defined processing methods. 
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srcFile = ' /data/374. xdf ' ; 

destFolder = ' /data/374_MoBI ' ; 

mobilab.allstreams = dataSourceXDF( srcFile, destFolder ); 

ind = mobilab.allStreams.getltemlndexFromltemClassf ' eeg' ) ; 

eegObj = mobilab.allstreams. itemf ind }; 

channels = l:eegObj .numberOf Channels; 

chann2ref = eegObj .label(channels) ; 

chann2avg = eegObj .label(channels) ; 

eegObj = eegObj . reReferencet chann2ref, chann2avg); 

filt_eegObj = eegObj .filter( 1 highpass' , 1, channels ); 

clean_eegObj = f ilt_eegObj .artif actRejectionO ; 

icaObj = clean_eegObj .ica(); 



% Raw MoBI data file in XDF format. 
% Destination (data processing) folder. 
% Import the XDF-f ormatted MoBI data file. 
% Find the index of the eeg object. 
H Get the handle to the eeg object. 

Use all the channels. 
% Select channels to be re- referenced (all). 
H Select channels to be averaged (all). 
% Convert selected channels to average reference. 
H Apply a 1-Hz high pass filter to all channels. 
% Apply the default (no param.) artifact rejection pipeline. 
% (See online documentation for details) 
°s Perform ICA decomposition using Infomax. 




Text Box 1 | Automatically generated script to run an EEG data 
processing pipeline (from reading an XDF-formatted MoBI dataset to 
performing ICA decomposition) as generated by the MoBILAB EEG 
menu item "Generate batch script" in Figure 4 (center). Each command 



that modifies the data outputs a new object that handles the processed data; 
this object is also inserted into the MoBILAB object tree. Therefore, in the 
example below, eegObj is used as a temporary reference to the latest 
processed EEG dataset. 



ind = mobilab.allstreams. getltemlndexFromltemdass ( 
mocapObj = mobilab.allstreams. item{ ind }; 

occ_mocapObj = mocapObj . removeOcclusionArtif act; 
f iltmocapObj = occ_mocapObj .lowpassf 6 ); 
diffOb] = f ilt_mocapObj .timeDerivativef 3 ); 



cap');^ Find the index of the mocap stream object. 
H Get the mocap stream object. 
*s Fill in occluded time points. 
H Perform 6-Hz low pass filtering. 
H Compute 1st- through 3rd-order time derivatives. 




Text Box 2 | A script implementing a MoBILAB pipeline for processing motion capture ("mocap") data (from stream separation to computing time 
derivatives). This script was also generated using the menu item "Generate batch script" in Figure 4 (right). 



MoBILAB EXTENSIONS 

Developers can use the MoBILAB infrastructure (stream objects 
and its signal processing and visualization methods) as building 
blocks for rapid development of new MoBILAB extensions (for- 
merly "plug-ins"). The example below shows a simple function 
that reconstructs the EEG channel data as the sum of only those of 
its independent components deemed to represent brain activity. 
One way of identifying "brain components" could be for instance 
to estimate the equivalent current dipole model of each indepen- 
dent component scalp map and then to select those components 
for which the residual variance of the scalp map not accounted for 
by the equivalent dipole model is less than some threshold. 

The example below (in Text Box 4) shows how to create a class 
for a new type of dataStream object by re-using existing classes. 
The new class, named icaEEG, is intended to be a placeholder for 
the results of ICA decomposition applied to EEG data. It inherits 
all the properties and methods of the class eeg and adds properties 
to store the ICA field information from the EEGLAB EEG dataset 
structure. The first method defined is the so-called constructor; 
this function is called automatically by MATLAB at the moment 
of object creation. The constructor function is mandatory and has 
the same name as the class itself. The second method is described 
in Text Box 3. Integrating new functions and classes into the 
MoBILAB class hierarchy allows users to access the new meth- 
ods directly from the contextual menu associated to each class. 
The third method uses the EEGLAB function pop_topoplot to dis- 
play IC scalp maps. The fourth method shows how to redefine 
methods already defined in a base class. In this case, the method 
EEGstructure is extended to add ICA fields to the EEGLAB EEG 
structure. 



EEG DATA PROCESSING 

Although, as Text Box 4 illustrates, MoBILAB can export an EEG 
dataStream object from a multi-stream data file to EEGLAB as an 
EEG structure, it can also be used to pre-process and export an 
EEG dataset after performing ICA decomposition. MoBILAB also 
contains some EEG processing methods (under development) not 
yet available in EEGLAB itself. 

FUTURE DIRECTIONS 

Here we have described MoBILAB, a software environment run- 
ning on MATLAB for analysis and visualization of multimodal 
MoBI paradigm experiment data. MoBI analysis, and so also 
MoBILAB methods, are yet at an early stage of development. 
We therefore have limited our description to its general infras- 
tructure, its Multi-Stream Browser, its motion capture data pre- 
processing facility, and its EEGLAB related features. At present, 
MoBILAB is a toolbox intended to provide researchers with basic 
tools for exploring their multimodal data. As the field of MoBI 
data analysis evolves, new methods will be added, specifically 
those for separately and jointly modeling brain and body dynam- 
ics using models incorporating more of the richness of the multi- 
modal (brain/body/environment) MoBI data concept. Modeling 
brain dynamics while also taking into account body dynamics and 
interactions with environmental events (and other agents) should 
provide a better basis for understanding how the human brain 
supports our behavior and experience in the ever-changing con- 
text of daily life, thereby also gaining a deeper understanding of 
"how the brain works." 

A possible way to model brain/body/environment dynam- 
ics might be to extend the methodology of Dynamic Causal 
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function eegObj = backProjectBrainComponents( icaObj ) 

%eegObj = backProjectBrainComponentst icaObj ) 
H Input: 

^ icaObj : icaEEG object, is the object that results 
% from the ICA decomposition of an eeg object. 

Is 

H Output: 

«t eegObj : eeg object that contains the back-projected 
% 'brain ICs' to the channel space 

H Create a new eeg stream object 

newHeader = createNewHeader ( icaObj .parent ); 



eegObj = icaObj .container. addltemt newHeader ); 



% Your code goes here 

indices = extractBrainComponentsf icaObj ); 
W = icaObj .icawinvt :, indices)'; 

eegObj .data = icaObj .data( : , indices) * W; 

if icaObj .lsGuiActive, icaObj . ref reshGui; end 
end 



% Define function name, input, and output parameters. 




H The easiest way to create a header file for a new object is 

H to modify an existing one. In this case we use the 

H information in ICA object's parent (also an eeg object) 

H Create the new eeg object and insert it into the data 
% object tree. 



^ Built-in method to estimate 'brain ICs' in icaEEG objects. 
\ Create an un-mixing matrix, retaining only the 'brain ICs' 
% Back-project the summed 'brain ICs' to the scalp channels. 

H If the MoBILAB GUI is active, refresh it (optional). 



Text Box 3 | A MATLAB function to back-project to the scalp channels only those independent components of EEG data estimated to represent brain 
activity. 
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classdef icaEEG < eeg 
properties 

icasphere = [ ]; 
icaweights = [ ] ; 
icawinv = [ ] ; 

end 

methods 

function obj = icaEEGl header ) 
obj@eeg( header ); 
load( header, 'icasphere', '-mat') 
load( header, ' icaweights' ,' -mat ' ) 
load( header, 'icawinv', '-mat') 
obj .icasphere = icasphere; 
obj .icaweights = icaweights; 
obj. icawinv = icawinv; 

end 

function eegObj = backProjectBrainComponents (obj ) 



function topoplott obj, scalpmaplndex ) 
EEG = obj .EEGstructure; 
pop_topoplot( EEG, 0, scalpmaplndex) 

end 

function EEG = EEGstructure! obj ) 
EEG 

EEG. icawinv 
EEG. icasphere 
EEG. icaweights 
EEG.icachansind 



% The class name is icaEEG; inheritance is from class eeg. 

% Define properties of the new class. 

% Sphering matrix. 

% ICA unmixing matrix. 

% ICA mixing matrix = inv(unmixing * sphering) 
% Define methods of the new class. 

H Constructor function (with the same name as the class). 

H Call to the parent class constructor. 

% Load ICA data fields from the header file. 



H Initialize the new icaEEG object properties. 

S Note that other properties have been initialized by the 

% constructor function of the parent class. 

H Back-project only the identified 'brain ICs' (see Text ■ 
% Box 3) . The definition of this function is not shown here 
% for the sake of brevity. 

% Use the EEGLAB function pop_topoplot (or implement your 
% own function here) 



); 



% Re-define a function in the parent class, adding only 
H the code needed to fill in the ICA information fields 
H in the EEGLAB EEG structure. 



end 



EEGstructure@eeg( obj 
= obj .icawinv; 
= obj .icasphere; 
= obj .icaweights; 

= obj. parentCommand.varargin{l}; 0 o The original list of channels decomposed by ICA 



end 



end 



Text Box 4 | A definition of the new dataStream class icaEEG in MoBILAB. Observe that MATLAB requires the class to be defined in a m-file whose name 
matches the name of the class. 



Modeling (Kiebel et al, 2009) first to the mechanics of the human 
body and then to its interface with the central nervous system 
(from spinal cord to the brain). Other approaches to MoBI data 
analysis might follow more data-driven approaches including 
those used in the field of BCI design (Makeig et al., 2012), whereby 



informative body and/or eye movement-defined events or fea- 
tures, extracted using body and eye movement models, might 
help classify and segregate EEG trials by cognitive state, response, 
or intention, thereby opening the possibility of adding pow- 
erful informative multimodal feature analysis to the repertoire 
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of EEG/MoBI data analysis (as well as to BCI modeling). In 
this regard, we hope to strengthen ties between the MoBILAB, 
BCILAB (Kothe and Makeig, 2013), and SIFT (Delorme et al., 
2011) toolboxes with a goal of better modeling EEG brain dynam- 
ics from multimodal data. 

As a work in progress, new MoBILAB methods, bug fixes, and 
scripting examples will be added to existing documentation at 
sccn.ucsd.edu/wiki/MoBILAB. In the spirit of collaboration and 
openness that has characterized the development of EEGLAB and 
other open source scientific software projects, MoBILAB is freely 
available under open source BSD license. Explicit instructions for 
downloading and/or cloning the repository are given on the wiki. 
The authors would be pleased to collaborate with other interested 
researchers to extend the capabilities of MoBILAB to serve the 
evolving needs of MoBI brain research. 
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